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Abstract 

Mean-square  consistent  estimators  for  both  the  two- 
dimensional  spectrum  and  the  instantaneous  variance 
of  non-stationary  white  noise  are  obtained  from  a  sin¬ 
gle  time  series.  Applications  to  real  sonar  data  indi¬ 
cate  that  these  estimators  can  be  adapted  to  both  detect 
and  recover  transients. 

1  Introduction 

Tb  motivate  this  paper,  a  brief  outline  of  the  back¬ 
ground  leading  to  our  results  on  transient  recovery  is 
given.  In  1991,  Herd  and  Gerr  (12j  presented  a  collec¬ 
tion  of  graphical  methods  to  display  the  presence  of 
periodic  correlation  in  non-stationary  time  series.  If  a 
time  series  is  periodically  correlated,  then  the  method 
of  diagonal  smoothing  is  a  consistent  estimator  of  the 
two-dimensional  spectrum  under  suitable  mixing  con¬ 
ditions  [9].  Once  an  estimate  of  the  spectrum  is  ob¬ 
tained,  the  associated  spectral  coherence,  the  coherent 
and  incoherent  collapse  can  graphically  display  the  pe¬ 
riodic  correlation. 

The  authors  of  this  p^er  applied  these  graphical 
methods  to  the  STRAP  dataset  of  the  DFDT  project 
[1].  This  dataset  contains  16,384  array  snapshots  from 
a  nine-sensor  random  array  recording  in  a  real  under¬ 
water  acoustic  environment.  An  area  of  spectral  co¬ 
herence  was  observed  to  exceed  a  false-alarm  thresh¬ 
old  of  Fq  =  0.001.  Both  the  coherent  and  incoher¬ 
ent  collapse  of  the  spectral  coherence  display  obvious 
periodic  patterns.  An  FFT  was  then  applied  to  the 
coherent  collapse  and  a  collection  ^ypically  three)  of 
very  clear  pulses  were  obtained.  On  examination  of 
this  pulse  train  and  the  original  time  series,  R.  Madan 
made  the  conjecture  that  this  method  had  recovered 
transients  from  the  time  series.  Thb  paper  uses  the 
model  of  non-stationary  white  noise  (NSWN)  [8]  to 
provide  a  theoretical  explanation  for  Madan’s  obser¬ 
vation. 

2  Non-Stationary  White  Noise 

Non-stationary  white  noise  processes  have  been  in 

the  electrical  engineering  literature  for  a  number  of 
years.  Standard  manipulations  typically  operate  us¬ 
ing  a  generalized  function  formalism.  For  example, 
Papoulis  [15]  delineates  non-stationary  white  noise  as 
those  random  process  with  zero  mean  and  co- 

variance  function  of  the  form 

=  Elr(t,)^]  =  -h)-  (1) 


Here  b(t)  denotes  the  Dirac  delta  function  and  the 
overline  denotes  the  complex  conjugate.  The  func¬ 
tion  will  be  called  the  instantaneous  variance. 

Thus,  /J**  is  a  generalized  function  supported  on  the 
main  diagonal  of  the  ti  x  Ij  plane.  Since  {x(t)} 
is  non-stationary,  it  is  of  interest  to  deternune  its 
two-dimensional  spectrum  Srx{fi,h)  defined  as  the 
Fourier  transform  of  the  covariance  function  [13]: 

•5r*(/i>  /z) 

J~-O0  -/-OO 

=  ^(/i  -  h)-  (2) 

Here  denotes  the  one-dimensional  Fourier  trans¬ 
form  of  the  instantaneous  variance.  Thus,  the  spec¬ 
trum  of  {x(t)}  is  constant  along  lines  of  constant  dif¬ 
ference  frequency  in  the  /j  x  /j  plane.  We  note  this 
observation  was  previously  obtained  by  Ogura  [14]  for 
time  series  (discrete  time).  This  diagonal  structure 
implies  that  5„(/i,/j)  should  be  amenable  to  esti¬ 
mation  via  the  diagonal  smoothing  technique  used  in 
periodically  correlated  processes  [12]  and  forms  the 
basis  for  the  estimators  used  in  this  paper.  However, 
there  are  technical  issues  with  continuous- time  white 
noise  processes  which  can  be  overcome  via  a  form  of 
Brownian  motion. 

3  Technical  Issues 

Discrete-time  NSWN  {x„},  their  associated  Fourier 
representation,  and  the  accompanying  development  of 
the  harmonizable  theory  has  been  undergoing  a  rigor¬ 
ous  exploration  by  Houdre  [6],  f7].  In  particular,  his 
non-stationary  white  noise  model  provides  an  excellent 
example  to  distinguish  between  L  and  R  harmonizable 
random  processes  [8]. 

However,  continuous-time  NSWN  {x(t))  requires 
additional  technical  considerations.  For  example,  the 
middle  term  of  equation  (1)  is  merely  a  formalism 
[3,  page  273).  Two  approaches  to  a  NSWN  randexn 
process  can  be  made.  First,  there  is  the  Gel’fand- 
Vilenkin  [3]  theory  of  generalized  random  processes. 
This  theory  provides  the  justification  for  the  formal 
but  non-trivial  manipulations  found  in  engineering 
texts.  Second,  there  is  the  integration  theory  for 
non-homogeneous  Brownian  motion  as  discussed  in 
Doob  [2].  This  theory  permits  non-stationary  white 
noise  to  be  approached  as  the  infinitesimal  of  a  non- 
homogeneous  Brownian  motion.  Both  approaches 
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have  their  merits  and  both  can  be  made  consistent 
by  introducing  the  following  ordinary  random  process 
{^(0) 

Definition  3.1  A  random  process  will  be 

called  an  L‘  Brownian  motion  provided  it  has  zero 
mean  and  there  is  a  positive  function  €  i-'CR) 
which  represents  the  covariance  function  as 

o\(t)dt. 

•oo 

Standard  statistical  arguments  show  that  ad¬ 

mits  a  version  which  is  real-valued,  Gaussian,  separ 
rable,  jointly  measurable,  and  has  continuous  sample 
paths.  These  properties  permit  the  interpretation  of 
{5(t)}  as  a  generalized  random  process  with  deriva¬ 
tive  x(f)  =  B‘[t)  satisfying  the  formalism 

9(tMt)dt  =  g(l)dB(t). 

From  this,  it  is  straight-forward  to  obtain 


Then  for  each  (/i./z)  >n  the  frequency  plane,  there 
holds: 

lun  S„(6,F;/,./2)  =  ^|(/,  -/2) 

F—oo 

in  quadratic  mean,  provided  6/F  — *  0. 

Theorem  4.2  shows  the  spectral  collapse  used  by 
Hurd  auid  Gerr  [12]  can  be  adapted  to  estimate  the 
instantaneous  variance.  What  makes  this  result  of  in¬ 
terest  is  the  appearance  of  the  Wignet  time-frequency 
distribution  and  suggests  a  connection  between  diag¬ 
onal  smoothing  and  time-frequency  estimators. 

Theorem  4.2  Suppose  {x(<)J  is  a  non-stationary 
white  noise  random  process  with  instantaneous  vari¬ 
ance  obtained  as  the  generalized  derivative  of  an 
L}  Brownian  motion.  Assume  (NWN-1),  fNWN-2), 
and  (NWN-3)  hold  and  madce  the  additional  assump¬ 
tion; 

(NWN-4)  There  is  an  a  >  1/2  such  that  al{t)  = 
0[|l|““]  as  f  — ►  oo. 

Define  the  Wigner  time-frequency  distribution  by  tak¬ 
ing  the  inverse  Fourier  transform  of  the  spectral  esti¬ 
mate  along  lines  of  constant  sum  frequency; 


-  h)- 

Thus,  a  meaning  can  be  attached  to  equation  (1),  the 
associated  covariance  function  A,,,  and  the  spectral 
estimators. 

4  Spectral  Estimators 

Theorem  4.1  shows  diagonal  smoothing  estimates 
the  2D  spectrum  of  NSWN  provided  the  usual  trade¬ 
offs  regarding  the  growths  of  the  time  and  frequency 
windows  are  made  to  force  consistency  of  the  estima¬ 
tor. 

Theorem  4.1  Suppose  {i(t)}  is  a  non-stationary 
white  noise  random  process  with  instantaneous  vari¬ 
ance  <rj(t)  obtained  as  the  generalized  derivative  of  an 
Brownian  motion.  Assume 

(NWN-1)  {*(<)}  is  real-valued 

(NWN-2)  {*(<))  is  Gaussian 

(NWN-3)  e  L^iR)  and  ^  6  L‘(Il). 

Let  the  finite  Fourier  transform  of  the  sample  be  de¬ 
noted 

2(6;/)  =  |^e-^'^'x(t)<ft. 

Consider  smoothing  the  “raw”  2D  spectrum  along  a 
diagonal  line  segment  through  [/i./q)'- 


W,Ab,F,U,tJ) 

=  [  e+‘"'“‘5„(6,F;/-l-u/2,/-u/2)du. 

J-u 

Coherent  collapse  over  frequency  gives; 

a*(6,F.t/,K;f)  =  ^  j''^W„{b,F,U-,t,f)df. 

Then  for  each  <  €  R,  there  holds; 

lim  <rJ(6,F,f/,U;f)  =  <rj(t) 


k  »  oo 
F  oo 
U  ^  oo 
V  oo 


in  quadratic  mean,  provided  U/b^’*  ^  — *  0  and 
UH/F  -*  0. 

5  Applications 

^  While  Theorem  4.1  estimates  the  Fourier  transform 
erj(/i  —  /2)  of  the  instauitaneous  variance  of  a  NSWN 
process  {x(t)},  some  comments  are  required  to  make 
the  connection  to  the  estimators  associated  with  spec¬ 
tral  coherence  as. used  by  Hurd  and  Gerr  (12). 

First,  Hurd  and  Gerr  [12]  work  with  time  series 
{xn}  rather  than  with  continuous-time  random  pro¬ 
cesses  {x(f)}.  Therefore,  the  spectral  estimator  of 
Theorem  4.1  will  be  implemented  using  a  discretiza¬ 
tion  of  Sxx{b,F\fi,f2).  The  notation  will  change  ac¬ 
cordingly.  Specifically,  the  finite  Fourier  transform 
will  be  implemented  by  applying  an  FFT  to  the  avail¬ 
able  stretch  of  data: 


S„(6,F;/i,/2) 


+  /)2(6;/2  +  /)cf/. 


N-l 

x(N-,m)  = 

n  =  0 
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We  are  tacitly  using  the  number  of  time  samples  N  to 
replace  the  continuous  time  interval  (— i.i] 

Second,  diagonal  smoothing  is  performed  by  aver¬ 
aging  over  a  diagonal  of  frequency  bins  instead  of  an 
interval.  Henceforth,  we  will  use  L  frequency  bins  to 
correspond  to  the  diagonal  smoothing  inter  vaJ  (— f,  f  j 
and  estimate  the  2D  spectrum  as 

I  i  _ 

5„(N,L;mi,m2)  =  »"2  +  0 

^  1=0 

Third,  the  false-alarm  threshold  of  Goodman  (4]  is 
used  as  follows:  Define  the  spectral  coherence  function 

_ Sxx{N,L\mi,m2) _ 

i2ii ,  rni)5xr(.^i  f*!  1212, 1212) 

provided  the  denominator  does  not  vanish.  Assume 
the  components  of  the  FFT  x(N;  m)  are  complex 
Gaussian  with  zero  mean  and  locaJly  constant  vari¬ 
ance.  That  is,  for  each  frequency  bin  there  holds 
E[\x{N-m)\'^]  =  E[\x{N,m  +  l)\^]  for  /  =  0,  . . .,  L. 
Then 

Prob(lCxx(lV,  L:mum:,)\^  >  =  (1  - 

Thus,  a  false-alarm  threshold  yo  for  probability  Pq  is 
given  by  (1  —  To)^~*  =  ^o  -  In  the  plots  of  spectral  co¬ 
herence,  only  those  features  exceeding  the  false-alarm 
threshold  determined  by  L  will  be  displayed. 

Fourth,  Hurd  and  Gerr  [12]  also  caJculate  the  col¬ 
lapsed  spectral  coherence  which  they  define  as  the 
mean  value  of  the  estimated  spectral  coherence  along 
a  diagonal  of  constant  difference  frequency: 

.  N—m 

Cxx(i^,L\m)  =  — -  Cxx(N,L-,m  +  in',m'). 

IS  —  m 

m'=0 

From  the  preceding  remarks,  it  is  reasonable  to  con¬ 
jecture  that  the  collapsed  coherence  will  also  be  a  rea¬ 
sonable  estimator  for  <7*.  In  light  of  Theorem  4.2,  we 
ako  conjecture  that  the  inverse  FFT  of  c„(W,  L;m)  is 
ako  a  reasonable  estimator  for  l<r*(0)|“^<7j(t„).  While 
Hurd  and  Gerr  [12]  collapse  over  the  entue  frequency 
plane,  we  will  restrict  the  collapse  to  those  regions  of 
the  frequency  plane  which  dkplay  a  high  levd  of  co¬ 
herence. 

Example  5.1  Amplitude-Modulated  Noise:  In 
thk  example,  a  totaJ  of  N  =  4,096  time  samples  sim¬ 
ulating  a  NSWN  signal  {s„}  in  additive  noise  were 
collected.  The  time  series  {r„}  has  the  form 

3 

"1"  ^  ]  l[0,.2j(^n  '^p')On  "f" 

f>  =  l 

The  Tp's  are  puke  arrival  times  uniformly  selected 
from  the  observation  interval.  The  time  samples  t„ 


correspond  to  a  sample  rate  of  300  Hertz  to  match 
the  STRAP  dataset.  The  forcing  term  {u{0}  's  IID 
uniform  [0, 1]  noise.  The  noise  term  [zn]  is  IID,  Gaus¬ 
sian  with  zero  mean,  a  variance  <t],  and  is  independent 
from  the  signal.  Thus,  {x„}  is  NSWN  with  instanta¬ 
neous  variance 

1  1 
Var[i„]  =  jr2  Z)  ~  +  5 ' 

p=i 

Figure  1  dkplays  both  the  puke  train  and  its  noke- 
corrupted  version  where  the  sample  variance  of  {z(<)} 
k  0.2101.  Figure  2  dkplays  a  contour  plot  of  the  esti¬ 
mated  spectral  coherence  obtained  by  16-bin  smooth¬ 
ing  and  thresholding  with  the  probability  of  fake 
alarm  Po  =  0.05.  Note  the  emergence  of  a  square 
patch  of  coherence  in  the  region  H  =  [0,5]  x  [0,5].  A 
coherent  collapse  was  performed  over  "R,,  and  a  zero- 
padded  inverse  FFT  was  applied.  The  results  are  dis¬ 
played  in  figure  3  which  plots  the  original  signal  and 
an  estimate  of  the  instantaneous  variance  (scaled  by 
|crj(0)l”^)  recovered  from  the  noise-corrupted  signal. 

Example  5.2  STRAP  DATASET:  Thk  dataset 
contains  16,384  array  snapshots  obtained  from  a  9- 
sensor  random  array  recording  in  a  real  underwater 
acoustic  environment.  For  thk  paper,  only  the  time 
series  ob tuned  from  sensor  #1  will  be  dkcussed  as 
sinular  results  are  obtained  from  the  remaining  sen¬ 
sors.  While  space  does  not  permit  the  dkplay  of  the 
time  series  in  thk  paper,  it  will  be  presented  in  the 
talk.  There  are  hints  of  transients  of  similar  shape 
near  2,  28,  and  53  seconds.  The  spectral  coherence  was 
estimated  over  the  region  [4, 13]  x  [4, 131  Hertz  in  the 
(/i./z)  frequency  plane  using  L  =  32  bin  frequency 
smoothing.  Figure  4  dkplays  the  resulting  spectral  co¬ 
herence  using  Po  =  0.001  to  set  the  threshold.  When 
the  coherent  collapse  of  the  spectral  coherence  was 
computed  over  the  square,  periodic  patterns  were  ob¬ 
served  in  the  magnitude  of  the  collapse.  An  FFT  was 
then  performed  ^uld  the  results  are  shown  in  figure  5. 
There  are  three  clear  spikes  which  seem  to  be  associ¬ 
ated  with  the  previously  mentioned  transients. 

6  Concluding  Remarks 

Theorems  4.1  and  4.2  demonstrate  that  non¬ 
stationary  white  noise  provides  one  model  in  which 
transient  recovery  via  the  Fourier  transform  of  the  col¬ 
lapsed  spectrum  makes  sense.  However,  there  remain 
a  number  of  topics  regarding  the  random  process,  the 
estimators,  and  applications  which  are  open  for  explo¬ 
ration. 

Reguding  the  random  process,  both  the  Gaussian 
assumption  and  the  bound  on  the  instantaneous 
variance  were  made  to  obtain  tractable  covariance 
bounds  for  Theorems  4.1  and  4.2.  Since  these  kinds  of 
bounds  are  also  obtained  using  various  mixing  condi¬ 
tions  [11],  it  seems  reasonable  to  conjecture  that  both 
the  Gaussian  assumption  and  the  Z,*  bound  may  be 
relaxed  and  Theorem  4.1  will  still  be  valid.  Moreover, 
it  ako  seems  reasonable  to  conjecture  Theorem  4.1  will 
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still  be  valid  if  the  white-noise  process  were  re¬ 

placed  by  process  {y(')}  which  had  a  covariance  liyy 
with  the  same  general  “shape"  as  the  white-noise  co- 
variance  Rzi  One  example  {y(t)}  could  be  obtained 
by  passing  {r(0)  through  a  linear  filter  y  =  h  »  x. 

Regarding  the  estimators,  it  seems  worthwhile  to 
explore  other  means  to  smooth  the  raw  spectrum,  es¬ 
pecially  when  working  with  limited  time  series.  In 
this  regard,  the  work  of  Thomson  {16]  seems  espe¬ 
cially  promising  as  a  means  to  include  the  length  of 
the  time  series  in  the  estimation  scheme.  The  ap¬ 
pearance  of  the  Wigner  distribution  in  Theorem  4.2 
is  of  interest  in  that  the  work  on  cross-term  suppres¬ 
sion  in  the  time-frequency  distributions  should  carry 
over  to  give  better  smoothing  windows  for  the  two- 
dimensional  spectrum.  In  this  regard,  we  point  out 
the  work  of  Wilbur  and  McDonald  [18]  as  having  made 
the  connection  between  the  Wigner  distribution  and 
cyclostationary  processes. 

Regarding  the  applications,  it  is  worthwhile  to 
point  out  that  the  use  of  the  false-alarm  threshold  is 
promising  as  a  means  of  transient  detection.  How¬ 
ever,  comparisons  need  to  be  made  with  this  method 
against  other  methods  of  transient  detection  and  es¬ 
timation,  such  as  a  short-time  variance  estimator  or 
time-frequency  distributions  to  also  detect  transients. 
In  this  regard,  the  work  of  Hearon  and  Amin  [5]  should 
be  pointed  out  as  establishing  a  statistical  criteria  for 
kernel  selection  for  a  time-frequency  distribution. 
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Figure  1:  Upper  Plot:  Random  pulse  train.  Lower 
Plot:  Pulse  train  in  N(Q^<rg)  noise. 
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Figure  2:  Estimated  spectral  coherence:  L  =  16  bin 
diagonal  smoothing;  Pq  =  0.05. 
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Figure  3:  Upper  Plot:  Random  puke  train.  Lower 
Plot:  Instantaneous  variance  (scaled  by  l<rjf0)|“^) 
obtained  from  the  inverse  FFT  of  the  coUapsea  spec¬ 
tral  coherence  over  the  region  It  =  (0,5)  x  (0,5). 
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Figure  4:  Estimated  spectral  coherence  of  the  time 
series  of  sensor  #  1  with  32-bin  diagonal  smoothing 
and  Pq  =  0.001. 
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Figure  5:  Upper  Plot:  Magnitude  of  coherent  col¬ 
lapse  of  the  spectral  coherence.  Lower  Plot:  Magni¬ 
tude  of  the  inverse  FFT  (zero-padded  to  16,384  points) 
of  the  coherent  collapse. 
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